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Applicant(s) 
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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- (f the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely, 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )M Responsive to communication(s) filed on 03 April 2005 . 
2a)n This action is FINAL. 2b)S This action is non-final. 

3) n Since this application is in condition for allowance except for fomial matters, prosecution as to the merits is 

closed in accordance with the practice under Expa/te Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-30 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) 13 Claim(s) 1^30 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomri PTO-152. 

Priority under 35 U.S.C. § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)n All b)n Some * 0)0 None of: 

1 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date . 6) [H Other: . 
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PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 20050705 



Application/Control Number: 09/975,527 
Art Unit: 2612 



Page 2 



DETAILED ACTION 

This case has been transferred to Examiner Kelly Jerabek. Please direct all 
future correspondence to Examiner Jerabek whose contact information can be found at 
the end of this office action. 

Response to Arguments 

Applicant's arguments, see Amendment page 6 filed February S^**, 2005, with 
respect to the rejection(s)of claim(s) 4-5 under USC 102 (Yokota) and USC 103 
(Bender) have been fully considered and are persuasive. Therefore, the rejection has 
been withdrawn. However, upon further consideration, a new ground(s) of rejection is 
made in view of Song US 4,783,840. 

Claim Objections 

Claims 7-8, 17-18, and 27-28 objected to because of the following informalities: 
These claims depend from cancelled claims 4, 14, and 24 which are now incorporated 
into claims 1,11, and 21 . Appropriate correction is required. However, for the 
purposes of examination the Examiner is treating claims 7, 1 7, and 27 as being 
dependent on claims 1,11, and 21 . 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-3, 7-13, 17-23, and 27-30 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bender et al. US 5,657,402 in view of Song US 4,783,840. 

Re claims 1,11, and 21 , Bender discloses a method comprising: focusing an 
imaging device over at least two different focal lengths; and forming an In-focus image 
including objects at two different focal lengths (Bender teaches capturing a sequence of 
images to form a composite image) (col. 8, lines 13-62). Additionally, Bender discloses 
evaluating the sharpness of portion of images taken at two different focal lengths 
(Bender teaches applying a weighting function to warped frames of a sequence of 
images) (col. 17, lines 42-58). However, Bender fails to distinctly state that the 
sharpness of portions of the images are evaluated on a pixel-by-pixel basis. 

Song discloses in figures 1-3 an image enhancement system (10) for enhancing 
image data by sharpening. The image enhancement system (10) evaluates the 
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sharpness of images on a pixel-by-pixel basis (col. 3, line 22-col. 5, line 5; col. 9, lines 
20-39). Therefore, it would have been obvious for one skilled in the art to have been 
motivated to include the concept of evaluating the sharpness of images on a pixel-by- 
pixel basis as disclosed by Song in the method of capturing a sequence of images to 
form a composite image disclosed by Bender. Doing so would provide a means for 
enhancing pixel values on a pixel-by-pixel basis (Song: col. 1, lines 45-50). 

Re claims 2, 12, and 22, Bender discloses automatically focusing an imaging 
device to at least two different focal lengths (see claim 1 above). 

Re claims 3, 13, and 23, Bender teaches capturing a sequence of images from a 
short focal length to a long focal length and using the sequence of images to form a 
composite image. Bender does not expressly disclose enabling the user to manually 
adjust the focal lengths. However, the Examiner takes Official Notice that manual 
operation of camera functions such as focal length adjustment is well known in the art. 
Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify Bender's teachings by enabling the user to manually 
adjust the focal lengths as an obvious variation to automatic control. 

Re claims 7, 17, and 27, Bender discloses comparing sharpness values of two 
captured frames and weighting pixels having sharpness values indicating better focus 
more than pixels that have sharpness values indicating poorer focus (Bender teaches 
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weighting frames of a higher resolution more heavily than frames of a lower resolution 
and thus inherently compares the frames respective sharpness values) (col. 17, lines 
42-58). 

Re claims 8, 18, and 28, Bender discloses generating a composite image 
containing image portions taken over at least two different focal lengths by comparing 
the quality of focus of two different image portions and weighting the image portion with 
better focus (Bender teaches weighting frames of a higher resolution more heavily than 
frames of a lower resolution and thus inherently compares the frames respective 
sharpness values) (col. 17, lines 42-58). 

Re claims 9, 19, and 29, Bender discloses transforming a subsequent frame to 
match the characteristics of a pervious frame taken at a different focal length (Bender 
teaches warping subsequent frame to match the first) (col. 8, line 51-col. 9, line 52). 

Re claims 10, 20, and 30, Bender discloses transforming the size of one of the 
two frames taken at different focal lengths (Bender teaches mapping smaller portions of 
a scene into a larger data space) (col. 8, line 51- col. 9, line 52). 

Claims 1-2, 6, 8-12, 16, 18-22, 26, and 28-30 rejected under 35 U.S.C. 103(a) 
as being unpatentable over Yokota at al. US 6,118,484 in view of Song US 
4,783,840. 
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Re claims 1,11, and 21 , Yokota discloses a method comprising: focusing an 
imaging device over at least two different focal lengths; and forming an in-focus image 
including objects at two different focal lengths (Yokota teaches capturing images of 
objects located at different distances by driving the focus lens group and combining the 
image data to form a composite image) (col. 6, line 57- col. 8, line 13). However, 
Yokota fails to distinctly state that the sharpness of portions of the images are evaluated 
on a pixel -by-pixel basis. 

Song discloses in figures 1-3 an image enhancement system (10) for enhancing 
image data by sharpening. The image enhancement system (1 0) evaluates the 
sharpness of images on a pixel-by-pixel basis (col. 3, line 22-coi. 5, line 5; col. 9, lines 
20-39). Therefore, it would have been obvious for one skilled in the art to have been 
motivated to include the concept of evaluating the sharpness of images on a pixel-by- 
pixel basis as disclosed by Song in the method of capturing a sequence of images to 
form a composite image disclosed by Yokota. Doing so would provide a means for 
enhancing pixel values on a pixel-by-pixel basis (Song: col. 1, lines 45-50). 

Re claims 2, 12, and 22, Yokota discloses automatically focusing an image 
device to at least two different focal lengths (see claim 1 above). 
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Re claims 6, 16, and 26, Song discloses evaluating sharpness on a pixel-by-pixel 
basis and storing sharpness information in an alpha channel (processor 12) associated 
with each pixel (col. 3, lines 22-58). Also, the pixel values that are stored do not include 
color information. 

Re claims 8, 18, and 28, Yokota discloses generating a composite image 
containing image portions taken over at least two different focal lengths by comparing 
the quality of focus of two different image portions and weighting the image portion with 
better focus (Yokota teaches capturing image of objects located at different distances 
by driving the focus lens group and combing the image data to form a composite image) 
(col. 6, line 57 - col. 8, line 13). 

Re claims 9, 19, and 29, Yokota discloses transforming a subsequent frame to 
match the characteristics of a previous frame taken at a different focal length (Yokota 
teaches an affine transfornnation) (col. 16, lines 44-52). 

Re claims 10, 20, and 30, Yokota discloses transforming the size of one of the 
two frames taken at different focal lengths (col. 16, lines 44-52). 



Contacts 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kelly L. Jerabek whose telephone number is (571) 
272-7312. The examiner can normally be reached on Monday - Friday (8:00 AM - 5:00 
PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached at (571) 272-^5«4t The fax phone number for 
submitting all Official communications is (571) 273-8300. The fax phone number for 
submitting informal communications such as drafts, proposed amendments, etc., may 
be faxed directly to the Examiner at (571) 273-7312. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

KLJ 




